Systems and methods for bandwidth-limited video transport

ABSTRACT

Systems and methods for bandwidth-limited video transport are configured to receive (or otherwise discern) a selection of video parameter limits that correspond to a bandwidth limit and apply the video parameter limits to an input video stream to enforce the bandwidth limit while preserving video quality. Methods may include adjusting the video stream one parameter at a time until the adjusted video stream meets the bandwidth limit. Parameters to be adjusted may include image resolution, frame rate, image compression, color depth, bits per pixel, and/or color encoding. In some embodiments, the image resolution is reduced first, the frame rate is reduced next, and the image compression is increased last. The extent and/or order of the adjustments of the parameters may be selected by the user, based on the content of the video stream, and/or based on the bandwidth limit.

RELATED APPLICATION

This application claims priority to U.S. Provisional Patent ApplicationSer. No. 62/344,600, entitled “SYSTEMS AND METHODS FOR BANDWIDTH-LIMITEDVIDEO TRANSPORT,” which was filed on Jun. 2, 2016, the completedisclosure of which is hereby incorporated by reference for allpurposes.

FIELD

The present disclosure relates to systems and methods forbandwidth-limited video transport.

BACKGROUND

Video conferencing, streaming, and broadcasting generally includedigital video transport over a communications channel such as dedicatedcable, a wireless connection, or the Internet. Especially for videoconferencing, streaming, and broadcasting, video transport systems areconfigured to provide the transmitted video stream(s) substantially‘live’ or in real time, without significant interruption of the videostream(s). Video transport systems may be configured to transmit video,audio, and other media (e.g., graphics, data, metadata), and may bereferred to as media transport systems.

Communications channels have a limited bandwidth and the bandwidth limitmay impact the transmission of video, especially if multiple channels ofhigh quality video are desired. Traditional solutions to managebandwidth include limiting the number of video streams transmittedand/or limiting the type and/or quality of video streams. Typicallybandwidth is restricted by rejecting video streams with too high of abandwidth demand and/or adjusting the high demand video stream to alower bandwidth stream. Video parameters such as image resolution (theimage height, image width, and number of pixels), frame rate,compression, color depth, and color encoding format, affect thebandwidth demand of a video stream. Lower image resolution, lower framerate, higher compression, lower color depth, and simpler color encoding(e.g., 4:2:0 Y′:C_(b):C_(r) encoding or grayscale only) may reduce thebandwidth requirements of a video stream. But, reducing bandwidththrough these parameters also reduces the quality of the video stream.

Traditionally, a user configures a video transport system for a balancebetween bandwidth demand and video quality on a per-video-source basis.If the video source changes (presenting different video parameters), thebalance may be disturbed and the video transport system may need to bereconfigured. For a dynamic system with variable video sources and/oradept video routing, the user may need to set the video parameters toaccommodate the highest demand video stream at the expense of videoquality for any other video streams. Setting parameters for the highestdemand stream may waste bandwidth for other (potentially less critical)streams. Setting parameters for the lowest demand (or even typicaldemand) may compromise quality of the higher demand streams.Additionally, users of video transport systems may not recognize theoptimal way to preserve video quality while adjusting video parametersfor a particular video stream or a range of video stream types.

SUMMARY

Systems and methods for bandwidth-limited video transport are configuredto receive a selection of video parameter limits from a user thatcorrespond to a bandwidth limit and apply the video parameter limits toan input video stream to enforce the bandwidth limit while preservingvideo quality. Additionally or alternatively, the systems and methodsmay be configured to discern the bandwidth limit and/or the videoparameter limits without user direction.

A method for enforcing a bandwidth limit in a video transport system mayinclude determining whether an input video stream needs adjustment tomeet the bandwidth limit. If the input video stream is over thebandwidth limit, the video stream may be adjusted one parameter at atime until the adjusted video stream is equal to or less than thebandwidth limit. Parameters to be adjusted may include image resolution,frame rate, image compression, color depth, bits per pixel, and/or colorencoding. In some embodiments, the image resolution is reduced first,the frame rate is reduced next, and the image compression is increasedlast. The extent and/or order of the adjustments of the parameters maybe selected by the user, based on the content of the video stream,and/or based on the bandwidth limit.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic representation of a video transport systemaccording to the present disclosure.

FIG. 2 is a schematic representation of a video input device in a videotransport system according to the present disclosure.

FIG. 3 is a schematic representation of video transport methodsaccording to the present disclosure.

FIG. 4 is a schematic representation of a video output device in a videotransport system according to the present disclosure.

FIG. 5 is a schematic representation of computerized systems accordingto the present disclosure.

DESCRIPTION

FIGS. 1-5 illustrate systems and methods for bandwidth-limited videotransport. In general, in the drawings, elements that are likely to beincluded in a given embodiment are illustrated in solid lines, whileelements that are optional or alternatives are illustrated in dashedlines. However, elements that are illustrated in solid lines are notessential to all embodiments of the present disclosure, and an elementshown in solid lines may be omitted from a particular embodiment withoutdeparting from the scope of the present disclosure. Elements that servea similar, or at least substantially similar, purpose are labelled withnumbers consistent among the figures. Like numbers in each of thefigures, and the corresponding elements, may not be discussed in detailherein with reference to each of the figures. Similarly, all elementsmay not be labelled or shown in each of the figures, but referencenumerals associated therewith may be used for consistency. Elements,components, and/or features that are discussed with reference to one ormore of the figures may be included in and/or used with any of thefigures without departing from the scope of the present disclosure.

FIG. 1 is a schematic representation of a video transport system 10(also called a bandwidth-limited video transport system). The videotransport system 10 includes a video source 20, a video input device 22,a bandwidth-limited link 24, a video output device 26, and a videodestination 28. The video transport system 10 may be part of, and/orintegrated with, a media transport system (which transports video andother forms of media such as audio). In the video transport system 10,the video source 20 generates (or sources) a video stream 32 that isreferred to as an input video stream 34. The input video stream 34 isconnected to the video input device 22, which adjusts the input videostream to form another video stream 32 that is a bandwidth-limited videostream 36. The bandwidth-limited video stream 36 is connected to thevideo output device 26 via the bandwidth-limited link 24. The videooutput device 26 receives the bandwidth-limited video stream 36 andforms another video stream 32 that is an output video stream 38. Theoutput video stream 38 is connected to the video destination 28 whichreceives (or consumes) the output video stream 38.

The video transport system 10 may include multiple video sources 20,multiple video input devices 22, multiple bandwidth-limited links 24,multiple video output devices 26, and/or multiple video destinations 28.A single video source 20 may transmit one or more video streams 32 tomultiple video input devices 22 (e.g., one video stream 32 to manydevices or a different video stream 32 for each device). A single videoinput device 22 may receive video streams 32 from multiple video sources20 and may transmit one or more video streams 32 to one or more videooutput devices 26. Video streams 32 may be transported through one ormore bandwidth-limited links 24 (e.g., one bandwidth-limited link 24 forall bandwidth-limited video streams 36 or different bandwidth-limitedlinks 24 for different bandwidth-limited video streams 36). A singlevideo output device 26 may receive video streams 32 from multiple videoinput devices 22 and may transmit one or more video streams 32 to one ormore video destinations 28 (e.g., one video stream 32 to many videodestinations 28 or a different video stream 32 for each videodestination 28). A single video destination 20 may receive one or morevideo streams 32 from multiple video output devices 26.

The video source 20 is a device that generates, reproduces, storesand/or transfers the input video stream 34 to the video input device 22.For example, the video source 20 may include, and optionally may be, acamera, a receiver (e.g., an audio-video receiver, a satellitereceiver), a video decoder, a media server (e.g., a video server), amedia player (e.g., a video player, a DVD player), and/or a streamingmedia device (e.g., a streaming video device).

The video streams 32 generally are digital video signals conveying videocontent. The video streams 32 may include other content such asassociated audio, closed captioning, time codes, secondary videocontent, and/or metadata related to the video content. If the videostream 32 includes video content and other content, the video stream 32may be referred to as a composite video stream. The video stream 32 maybe transferred between devices using a digital communication protocoland/or interface (e.g., HDMI (High-Definition Multimedia Interface), SDI(Serial Digital Interface), DisplayPort, USB (Universal Serial Bus),FireWire (IEEE 1394), IP (Internet Protocol), UDP (User DatagramProtocol), TCP (Transmission Control Protocol), RTP (Real-time TransportProtocol), AES67 (Audio Engineering Society), and AVB (Audio VideoBridging)). The input video stream 34 and/or the output video stream 38may include and/or may be analog video signals sourced and/or receivedby the respective video source 20 and/or video destination 28. Analogsignals may be converted to digital signals by an analog to digitalconverter (and vice versa by a digital to analog converter).

Video streams 32 may be directed between the video source 20, the videoinput device 22, the video output device 26, and/or the videodestination 28 by a physical communications channel (e.g., wired orwireless connection). Additionally or alternatively, video streams 32may be transported via logical channels (also called ports) within aphysical communications channel. For example, the communicationschannels may be digital network channels and/or ports configuredaccording to various communications protocols such as TCP/IP and/or AVB.

The video input device 22 is a device that is configured to receive theinput video stream 34 from the video source 20 and configured to adjustthe input video stream 34 to fit within a bandwidth limit specified by auser 12 and/or a bandwidth limit of the bandwidth-limited link 24. Theinput video stream 34 as adjusted for the bandwidth limitations is thebandwidth-limited video stream 36. If the input video stream 34 iscompatible with the bandwidth limit, the video input device 22 maytransmit the input video stream 34 as the bandwidth-limited video stream36. The video input device 22 also is configured to transmit thebandwidth-limited video stream 36 to the video output device 26 via thebandwidth-limited link 24. If the video input device 22 receivesmultiple input video streams 34, the video input device 22 may select anactive (or selected) video stream 32 among the input video streams 34for processing to produce the bandwidth-limited video stream 36. Thevideo input device 22 may include a video selector, a video switch,and/or a video mixer to select the active input video stream 34. If theinput video stream 34 is a composite video stream, the video inputdevice 22 may extract and/or separate the video content from thecomposite video stream for processing to produce the bandwidth-limitedvideo stream 36.

The bandwidth-limited link 24 is a physical and/or logicalcommunications channel between the video input device 22 and the videooutput device 26. Generally, the bandwidth-limited link 24 is part of avideo-capable network. The bandwidth-limited link may be a fixed ordynamic topology. For example, the bandwidth-limited link 24 may be adirect cable connecting the video input device 22 and the video outputdevice 26. As another example, the bandwidth-limited link 24 may be adigital communication network between one or more video input devices 22and one or more video output devices 26. The bandwidth-limited link 24may be the entirety or a portion of an AVB network, a CobraNet network,and/or an AES67 network.

Communications channels (whether physical or logical), such as thebandwidth-limited link 24, have bandwidth limits (maximum capacity)beyond which communication is not possible or is significantly degraded.Logical ports may have independent bandwidth limits and/or all logicalports within a communications channel may have a shared bandwidth limit.The bandwidth-limited link 24 is a communications channel with abandwidth limit generally less than the bandwidth limits of othercommunications channels in the video transport system 10. The user 12may desire to restrict the bandwidth of the video stream 32 through thebandwidth-limited link 24 to a value below the maximum capacity of thebandwidth-limited link 24. The bandwidth of multiple video streams 32that are to be transported through a single bandwidth-limited link 24may be limited such that the total bandwidth consumed by the videostreams 32 is less than the maximum capacity of the bandwidth-limitedlink 24. Additionally or alternatively, the bandwidth of one or morevideo streams 32 may be limited to permit (and/or reserve capacity for)other traffic in the same bandwidth-limited link 24. Using the systemsand methods of the present disclosure, the user 12 may allocate adifferent bandwidth limit to each bandwidth-limited video stream 36(e.g., bandwidth limits may be allocated on a per video stream basis).Video streams 32 with a higher bandwidth may be higher quality videostreams 32 and/or a higher bandwidth limit may support a higher qualityvideo stream 32.

The video output device 26 is a device that is configured to receive thebandwidth-limited video stream 36 from the video input device 22 andconfigured to adjust the bandwidth-limited video stream 36 tosubstantially reconstruct the input video stream 34 from thebandwidth-limited video stream 36. The bandwidth-limited video stream 36as adjusted to reconstruct the input video stream 34 is the output videostream 38. The video output device 26 may configure the output videostream 38 for the video destination 28. For example, the output videostream 38 may be output with a fixed set of video parameters (e.g.,image resolution, frame rate, color depth, color encoding format, etc.)and/or one or more video parameters associated with and/or preferred bythe video destination 28.

The video destination 28 is a device that receives, renders (e.g.,displays), stores, and/or transfers the output video stream 38 from thevideo output device 26. For example, the video destination 28 mayinclude, and optionally may be, a video monitor, a personal computer, amobile phone, a video projector, a receiver (e.g., an audio-videoreceiver), a video encoder, and/or a media server (e.g., a videoserver). The video destination 28 may receive content related to thevideo content of the output video stream 38 (e.g., audio). Relatedcontent may be transmitted in the output video stream 38 or transmittedto the video destination 28 via an alternate communications channel.

FIG. 2 is a schematic representation of the video input device 22 of thevideo transport system 10. The video input device 22 includes a videoinput port 42, a video output port 44, and a facility to accept inputfrom the user 12. For example, the video input device 22 may include auser interface to interact with the user 12 and/or a communicationschannel to receive a selection of video parameters and/or the bandwidthlimit. In the video input device 22, video streams 32 that arrive at thevideo input port 42 are transferred (as optionally processed) to thevideo output port 44. The video input device 22 may include one or morevideo input ports 42 and/or one or more video output ports 44. Videostreams 32 may be directed between any video input port 42 and any videooutput port 44. Video streams 32 may be processed within the video inputdevice 22, multiple video streams 32 may be merged, and/or a videostream 32 may be replicated. Each video input port 42 and each videooutput port 44 independently may be a physical channel (e.g., a wired orwireless connection) or may be a logical port within a communicationschannel that utilizes a physical channel. For example, all video inputports 42 may be logical ports in a single communications channel. Asanother example, some video output ports 44 may be logical ports in asingle communications channel and different video output ports 44 may beconnected to different communications channels.

The incoming, active, or selected input video stream 34 of the videoinput device 22 may change during operation of the video transportsystem 10. For example, two video sources 20 with different videoparameters may be connected such that each provides a respective inputvideo stream 34 to the video input device 22. Either of the input videostreams 34 may be selected as desired (e.g., by the video input device22 or by a switch upstream of the video input device 22), resulting invarying video parameters presented to the video input device 22. Hence,the input video stream 34 operated on by the video input device 22 maychange video parameters while the video transport system 10 isoperating. The systems and methods of the present disclosure areconfigured to automatically adjust the video parameters of thebandwidth-limited video stream 34 to achieve the user-defined minimumvideo quality while maintaining the bandwidth limit. The videoparameters may be adjusted selectively and/or to the extent needed toachieve the bandwidth limit. Hence, the systems and methods of thepresent disclosure are configured to substantially preserve videoquality in an optimal or near optimal fashion while enforcing thebandwidth limit.

The systems and methods of the present disclosure do not rely on apriori knowledge of the content type of the input video stream. However,the systems and methods of the present disclosure may be configured todetermine and/or use content type of the input video stream (e.g., livesports, video conference, presentation graphics, etc.) to furtheroptimize the image quality while maintaining the output video streamunder the output bandwidth limit.

In the example of FIG. 2, the video input device 22 includes severalmodules to automatically adjust the bandwidth of the input video stream34 and to transmit the bandwidth-limited video stream 36 from the videooutput port 44. Modules include a configuration module 60, a bandwidthlimiting module 62, and at least one video adjustment module 64 toadjust the video parameters of the video stream. Further, the videoinput device 22 may include an input conditioning module 72 upstream ofthe video adjustment module(s) 64 that is configured to condition theinput video stream 34 before processing by the video adjustmentmodule(s) 64.

As illustrated in the example of FIG. 2, the video adjustment modules 64may include modules dedicated to performing independent adjustment tothe video content of the input video stream 34, for example, a videoscaling module 66 to scale the image resolution, a video frame ratetransformation module 68 to transform the frame rate (also referred toas the image repetition rate), and/or a video compression module 70 tocompress the video stream. Video adjustment modules 64 may adjust one ormore video parameters. Different video adjustment modules 64 may eachadjust different video parameters. Additionally or alternatively, twovideo adjustment modules 64 may adjust the same video parameter(typically in different manners or in conjunction with differentcombinations of video parameters).

Each video adjustment module 64 operates on a video stream input to thatmodule, which may be referred to as a module operand video stream and amodule input video stream. The module operand video stream of one of themodules may be the input video stream 34 (or the (conditioned) inputvideo stream 34 as described further herein). Such a video adjustmentmodule 64 would be the most upstream of the video adjustment modules 64.For example, the video scaling module 66 in the example of FIG. 2 is themost upstream of the adjustment modules 64, even though the videoscaling module 66 may be downstream of the input conditioning module 72(the module operand video stream of the video scaling module 66 would bethe (conditioned) input video stream 34 output from the inputconditioning module 72 as described further herein).

The input conditioning module 72, if present, is upstream of the videoadjustment module(s) 64. The input conditioning module 72 accepts theinput video stream 34 and produces a (conditioned) input video stream 34that is input to the most upstream of the video adjustment modules 64.In an example configuration, the input conditioning module 72 may be aninput decompression module that is configured to decompress the inputvideo stream 34 to produce an (uncompressed) input video stream 34. Asanother example, the input conditioning module 72 may be an inputselection module that is configured to select one or more input videostreams 34 to produce an (active) input video stream 34 (e.g., the inputselection module includes a video switch and/or a video mixer). Whereused with respect to the video adjustment modules 64 and if the inputconditioning module 72 is present, the input video stream 34 refers tothe (conditioned) input video stream 34.

The video adjustment modules 64 are cascaded such that the videoadjustment modules 64 operate (if needed) in series on the input videostream 34 to produce the bandwidth-limited video stream 36. Thus, amodule may be referred to as being upstream or downstream of othermodules, with upstream modules closer to the video input port 42 anddownstream modules closer to the video output port 44. Though the mostupstream of the video adjustment modules 64 may operate on the inputvideo stream 34, the input video stream 34 may be conditioned (e.g.,adjusted, buffered, filtered, decompressed, selected, mixed, orotherwise operated on) by the input conditioning module 72 prior totransmission to the most upstream of the video adjustment modules 64 (nodirect connection between the video input port 42 and the most upstreammodule is necessary). Though the most downstream of the video adjustmentmodules 64 may produce the bandwidth-limited video stream 36, the videostream output from the most downstream of the video adjustment modules64 may be adjusted, buffered, filtered, or otherwise operated on priorto presentation at the video output port 44 (no direct connectionbetween the video output port 44 and the most downstream of the videoadjustment modules 64 is necessary).

The video scaling module 66 is configured to apply an image scale factorto a video stream input to the module (which may be referred to as ascaling operand video stream and a scaling input video stream) toproduce a scaled video stream at the output of the module. The scaledvideo stream has an image resolution that is scaled by an image scalefactor. That is, the image resolution of the scaled input video streamis the image scale factor times the image resolution of the scalingoperand video stream. The video scaling module 66 is generallyconfigured to reduce the image resolution of the video stream as it ispassed through the module. Hence, the image scale factor is typically avalue less than one. Algorithms to reduce the image resolution includedownsampling (eliminating pixels, typically periodically) and decimation(applying an antialiasing filter and/or a low pass filter and thendownsampling). For speed of processing, image scale factors may belimited to (and/or applied as) inverse integers or integer fractions. Ifthe scaling operand video stream is compressed, the video scaling module66 may decompress the video stream prior to applying the image scalefactor. The video scaling module 66 generally does not re-compress avideo stream that has been decompressed to apply the image scale factor.

Image resolution is a measure of the number of pixels in an individualvideo frame. The image resolution may be expressed as the height andwidth (i.e., image height and image width) of the video frames.Additionally or alternatively, image resolution may be expressed as thenumber of pixels in each of the video frames, the number of pixels beingthe height times the width. As used herein, a factor times an imageresolution is the factor times the width and the factor times theheight. Thus, the corresponding number of pixels is the factor squaredtimes the original number of pixels.

As used herein, when comparing image resolutions, the comparisons arethe conjunction (i.e., logical ‘and’ function) of the comparisons of thecorresponding heights and widths. Thus, a first image resolution is lessthan a second image resolution if the height of the first imageresolution is less than the height of the second image resolution andthe width of the first image resolution is less than the width of thesecond image resolution. Unless noted otherwise, the systems and methodsof the present disclosure include (in addition or in alternate) thecomparison of image resolutions by other comparisons of thecorresponding numbers of pixels and/or comparisons of the correspondingheights and/or widths (i.e., individually, non-exclusively disjunctively(i.e., logical ‘or’ function), or exclusively disjunctively (i.e.,logical ‘xor’ function)). For example, the expression ‘the first imageresolution is less than the second image resolution’ may be substitutedwith ‘a number of pixels of the first image resolution is less than anumber of pixels of the second image resolution.’ As other examples, thesame expression may be expressed as the height and/or the width of thefirst image resolution is less than the respective height and/or widthof the second image resolution, e.g., ‘a height of the first imageresolution is less than a height of the second image resolution’ or ‘aheight of the first image resolution is less than a height of the secondimage resolution or (i.e., logical ‘or’ function) a width of the firstimage resolution is less than a width of the second image resolution.’

The video frame rate transformation module 68 is configured to apply aframe rate transformation factor to a video stream input to the module(which may be referred to as a frame-transformation operand video streamand a frame-transformation input video stream) to produce aframe-reduced video stream at the output of the module. Theframe-reduced video stream has a transformed frame rate that is theframe rate transformation factor times the frame rate of theframe-transformation operand video stream. The frame rate transformationfactor is a value less than or equal to one. Algorithms to reduce theframe rate include downsampling (eliminating frames, typicallyperiodically) and decimation (applying an error-correcting filter and/ora low-pass filter and then downsampling). For speed of processing, framerate transformation factors may be limited to (and/or applied as)inverse integers or integer fractions. For speed of processing,transformed frame rates due to frame rate transformation factors may belimited to (and/or applied as) integers or integer fractions. If theframe-transformation operand video stream is compressed, the video framerate transformation module 68 may decompress the video stream prior toapplying the frame rate transformation factor. The video frame ratetransformation module 68 generally does not re-compress a video streamthat has been decompressed to apply the frame rate transformationfactor.

The video compression module 70 is configured to apply a compressionfactor conversion to a video stream input to the module (which may bereferred to as a compression operand video stream and a compressioninput video stream) to produce a compressed video stream at the outputof the module. The compressed video stream has a compression factor thatis the compression factor conversion times the compression factor of thecompression operand video stream. As illustrated in the example of FIG.2, the video stream input to the video compression module 70 may be theoutput of another (upstream) video adjustment module 64. If the upstreamvideo adjustment module 64 has adjusted the video stream, the videostream may be uncompressed (a compression factor of unity). Thus, thecompression factor of the compressed video stream would be equal to thecompression factor conversion.

As used herein, a compression factor is the ratio of the size of theinput bitstream to the size of the output bitstream. When no compressionis present or achieved, the input bitstream is the same size as theoutput bitstream and the compression factor is unity (1). Whencompression is present or achieved, the size of the output bitstream isless than the size of the input bitstream and the compression factor isgreater than unity, with larger values indicating more compression. Forvideo bitstreams, common compression algorithms may achieve compressionfactors of at least 2, 5, 10, 20, or 50. A related parameter is thecompression ratio. The compression ratio is the inverse of thecompression factor and is the ratio of the size of the output bitstreamto the size of the input bitstream. Systems and methods of the presentdisclosure may use the compression ratio in place of the compressionfactor by accounting for the mathematical inverse of the replacement.

Compression algorithms to compress a video stream include (but are notlimited to) H.265/HEVC (ITU-T and ISO/IEC), H.264/AVC (ITU-T andISO/IEC), H.263 (ITU-T), H.261 (ITU-T), M-JPEG (ISO/IEC), MPEG-4(ISO/IEC), MPEG-2 (ISO/IEC), MPEG-1 (ISO/IEC), VP9 (Google), and VP8(Google). Compression algorithms to compress and decompress a videostream may be referred to as video codecs. One of skill in the artrecognizes how to apply a compression algorithm to achieve a givencompression factor (for example by specifying the target output bitrate).

Compression algorithms may be variable bit rate algorithms or constantbit rate algorithms. A variable bit rate algorithm generates an outputbitstream with a size that depends on the content of the inputbitstream. Generally a more complicated video image or segment wouldresult in a larger compressed bitstream than a less complicated videoimage or segment. A constant bit rate algorithm generates an outputbitstream with a substantially constant bit rate. The bit rate does notsubstantially vary according to the complexity of the input. However,constant bit rate algorithms do not necessarily produce a preciselyconstant bit rate. The bit rate from frame to frame may vary but thevariance may be limited due to the constant bit rate algorithm. Someconstant bit rate algorithms may have a frame to frame bit rate varianceof less than 50%, 20%, 10%, or 5%. Some constant bit rate algorithms maylimit the maximum bit rate to less than 50%, 20%, 10%, or 5% more thanthe nominal (or average) bit rate.

With regard to planning for bandwidth requirements, the bit rate of botha variable bit rate algorithm and a constant bit rate algorithm may beestimated as the maximum expected bit rate of the algorithm. Thedifference between the estimated bit rate and the actual bit rate isbandwidth that is not utilized (by the compressed video; the bandwidthgenerally is still consumed by the media flow). Therefore, theefficiency of allocating bandwidth may be facilitated by using aconstant bit rate algorithm and, in particular, a constant bit ratealgorithm with a low bit rate variance (e.g., less than 10%).

The configuration module 60 of the video input device 22 may beconfigured to receive a selection of target video parameterscorresponding to a bandwidth limit. The configuration module 60 may beconfigured to determine the bandwidth limit based upon the target videoparameters and/or may be configured to receive the bandwidth limit aspart of or the entirety of the selection of target video parameters.Generally, the target video parameters are video parameters thatcorrespond to video quality. For example, the target video parametersmay include an image resolution limit (e.g., a height limit, a widthlimit, and/or a pixel number limit), a frame rate limit, and/or acompression factor limit. The target video parameters may include otherparameters additionally or alternatively, such as color depth, bits perpixel, and/or color encoding. Further, the configuration module 60 maybe configured to estimate and/or determine any or all of the targetvideo parameters based upon a user selection of the video type and/orsource. The configuration module 60 may include a user interface tointeract with the user 12.

The image resolution limit is the maximum permitted value and is a valuespecified, transmitted, or otherwise provided by the user 12. The imageresolution limit is also essentially the minimum acceptable imageresolution for quality purposes. However, as disclosed herein, if theinput video stream 34 has an image resolution (its native imageresolution) that is less than the image resolution limit, the systemsand methods of the present disclosure will transmit the adjusted videostream with the native image resolution of the input video stream 34(less than the image resolution limit). That is, low resolution inputvideo generally will not be scaled to higher resolution at the output ofvideo input device 22.

Similarly, if the input video stream 34 has an image resolution that isgreater than the image resolution limit but the bandwidth consumed bythe input video stream 34 (as adjusted by any prior video parameteradjustments, e.g., frame rate adjustment) is less than the bandwidthlimit, the systems and methods of the present disclosure generally willtransmit the adjusted video stream with the native image resolution ofthe input video stream 34 (greater than the image resolution limit).That is, high resolution input video may be only scaled to lowerresolution if the bandwidth limit is exceeded at the input of the videoinput device 22 (e.g., at the video input port 42) and/or the input ofthe video scaling module 66. In some embodiments, it may be desirable tomaintain the image resolution of the bandwidth-limited video stream 36at the video output port 44 (e.g., to avoid excess mode changes inrendering devices downstream of the video input device 22, e.g., thevideo output device 26 and/or the video destination 28). In such a case,the video scaling module 66 may scale the scaling operand video streameven if not necessary to meet the bandwidth limit. Additionally oralternatively, the bandwidth-limited video stream 36, after exit fromthe video output port 44 and after transport across thebandwidth-limited link 24, may be scaled to the desired resolution.

The frame rate limit is the minimum permitted value and is a valuespecified, transmitted, or otherwise provided by the user 12. The framerate limit is also essentially the minimum acceptable frame rate forquality purposes. However, as disclosed herein, if the input videostream 34 has a frame rate (its native frame rate) that is less than theframe rate limit, the systems and methods of the present disclosure willtransmit the adjusted video stream with the native frame rate of theinput video stream 34 (less than the frame rate limit). That is, lowframe rate input video generally will not be transformed to higher framerate at the output of the video input device 22.

Similarly, if the input video stream 34 has a frame rate that is greaterthan the frame rate limit but the bandwidth consumed by the input videostream 34 (as adjusted by any prior video parameter adjustments, e.g.,image scaling) is less than the bandwidth limit, the systems and methodsof the present disclosure generally will transmit the adjusted videostream with the native frame rate of the input video stream 34 (greaterthan the frame rate limit). That is, high frame rate input video mayonly be transformed to lower frame rate if the bandwidth limit isexceeded at the input of the video input device 22 (e.g., at the videoinput port 42), and where it is transformed, the lower frame rate willnot be lower than the frame rate limit. In some embodiments, it may bedesirable to maintain the frame rate of the bandwidth-limited videostream 36 at the video output port 44 (e.g., to avoid excess modechanges in rendering devices downstream of the video input device 22,e.g., the video output device 26 and/or the video destination 28). Insuch a case, the video frame rate transformation module 68 may transformthe frame rate of the frame-transformation operand video stream even ifnot necessary to meet the bandwidth limit. Additionally oralternatively, the bandwidth-limited video stream 36, after exit fromthe video output port 44 and transport across the bandwidth-limited link24, may be frame rate transformed to the desired frame rate.

The compression factor limit is the maximum permitted value and is avalue specified, transmitted, or otherwise provided by the user 12. Thecompression factor is also essentially the maximum acceptablecompression for quality purposes. Generally, the input video stream 34is uncompressed or is subject to decompression upstream of the videoinput device 22 and/or the first of the video adjustment modules 64. Inthe example of FIG. 2, the input conditioning module 72 of the videoinput device 22 may include and/or may be an input decompression modulethat is configured to decompress the input video stream 34 if it iscompressed. The output of the input conditioning module 72 in thisexample would be the (uncompressed) input video stream 34. The(uncompressed) input video stream 34 is the operand input for the videoadjustment modules 64 of the video input device 22 (the first videoadjustment module 64 being the video scaling module 66).

Relative to evaluating the bandwidth limit and other video adjustmentparameters (e.g., the image resolution, the frame rate, etc.), thebandwidth consumed by the (uncompressed) input video stream 34 is therelevant bandwidth of the input video stream 34. One exception is that,if the input video stream 34 is compressed (at greater than, equal to,or less than the compression factor limit) and the input video stream 34at the video input port 42 has a bandwidth that is less than or equal tothe bandwidth limit (thus, no video parameter adjustments would beneeded) then the input video stream 34 may be transmitted in originalform from the video input device 22 as the bandwidth-limited videostream 36. If the input video stream 34 at the video input port 42(whether initially compressed or not) exceeds the bandwidth limit, theinput video stream 34 generally is decompressed if necessary (before orafter arriving at the video input port 42) and the (uncompressed) inputvideo stream 34 is operated on by the video adjustment modules 64(optionally including the video compression module 70) to achieve thebandwidth limit in the bandwidth-limited video stream 36.

Where a bandwidth of a video stream (or the bandwidth limit) iscalculated or estimated, the bandwidth is the product of the number ofpixels corresponding to the image resolution, the frame rate, the numberof bits per pixel corresponding to the color depth and the colorencoding format, and the compression ratio (the inverse compressionfactor). The calculated or estimated bandwidth may further includefactors or addends which account for overhead (e.g., transmissionprotocol overhead, encryption overhead, etc.), headroom (e.g.,reservation of unfilled bandwidth), and/or co-transmitted data (e.g.,corresponding audio and/or metadata). Where one or more values needed tocompute the bandwidth is not available, an estimate may be used. Theestimate may be a worst case estimate (leading to calculating and/orestimating the largest bandwidth with respect to this parameter), avalue based upon expectations (e.g., a particular image resolution andframe rate may be commonly associated with a particular number of bitsper pixel), or a value based upon prior use. For example, continuoustone images (real scenes and high quality renderings) commonly aretransmitted in a 4:2:0 (Y′:C_(b):C_(r)) sampling at 8 bits percomponent, resulting in an average of 12 bits per pixel, or a 4:2:2(Y′:C_(b):C_(r)) sampling at 10 bits per component, resulting in anaverage of 20 bits per pixel.

The bandwidth limiting module 62 of the video input device 22 isconfigured to control the operation of the video adjustment modules 64and the routing of the video stream through the video input device 22.The bandwidth limiting module 62 is configured to determine if the inputbandwidth of the input video stream to the video input device 22 isgreater than the bandwidth limit (e.g., as defined by the user 12). Ifthe input bandwidth is less than or equal to the bandwidth limit, thebandwidth limiting module 62 may be configured to transmit the inputvideo stream from the video input port 42 to the video output port 44unaffected (no video parameter changes). Additionally or alternatively,the bandwidth limiting module 62 may direct the video adjustment modules64 to transmit the video stream across each module without any videoparameter changes if the input bandwidth is less than or equal to thebandwidth limit. If the input bandwidth is greater than the bandwidthlimit, the bandwidth limiting module 62 directs the video adjustmentmodules 64 to selectively adjust the video parameters of the videostream to achieve the bandwidth limit.

The bandwidth limiting module 62 may determine the video parameters ofthe input video stream 34 (or the (conditioned) input video stream 34)and transmit the determined video parameters (and/or a proxy such asinput quality or a subset) from the video input device 22 to the videooutput device 26. For example, the determined video parameters may beembedded in the bandwidth-limited video stream 36 as metadata. Asanother example, the determined video parameters may be communicated tothe video output device 26 through an alternate communications channel.Transmission of the video parameters (and/or a proxy such as the videoquality or a subset of parameters) may facilitate the restoration of theinput video stream 34 at the video output device 26.

The bandwidth limiting module 62 may be configured to control theoperation of the input conditioning module 72 (e.g., to select the(active) input video stream 34, to decompress the input video stream 34to produce the (uncompressed) input video stream 34) If the inputbandwidth of the input video stream 34 is less than or equal to thebandwidth limit, the bandwidth limiting module 62 may direct the inputconditioning module 72 to pass the input video stream 34 unaffected.

The operation of the bandwidth limiting module 62 in conjunction withthe video adjustment modules 64 generally follows the methods 100illustrated in FIG. 3. The general operation of the bandwidth limitingmodule 62 may be expressed as a while loop: while the bandwidth 108 (BW)of the video stream 32 is greater than the bandwidth limit (BW_(max)),calculate 102 one or more video attributes 110 that, when applied to thevideo stream (via a step of adjusting video 104), will cause the videostream to achieve the bandwidth limit or will reduce (at least notincrease) the bandwidth of the video stream while conforming to thevideo parameter limits (e.g., the image resolution limit, the frame ratelimit, and/or the compression factor limit). In FIG. 3, inputs to thewhile loop are illustrated on the left and outputs are illustrated onthe right. Objects that are modified within the loop (i.e., the videostream 32 and the bandwidth 108) have horizontally aligned inputs andoutputs. Though the example of FIG. 3 illustrates the calculation 102and the adjustment 104 occurring within the same loop, methods 100 mayinclude performing the calculation 102 to identify which videoparameters 112 to adjust and the amount of adjustment (by calculating102 the corresponding attributes 110) for all video parameters 112 andthen adjusting 104 the video stream according to the video parameters112 and attributes 110 calculated by the calculating 102.

Calculating 102 includes receiving as inputs the limits associated withone or more video parameters, the current value of the correspondingvideo parameters 112, and the current value of the bandwidth 108 (BW).Calculating 102 includes determining whether the current values of thevideo parameters 112 conform to the associated video parameter limits.If the current values do not conform to the limits, calculating 102includes determining an attribute 110 that reduces the bandwidth 108. Ifthe current values conform to the limits, calculating 102 directs thewhile loop to pass to the next iteration or otherwise directs and/orindicates no change to the subject video parameter values (and the videostream 32 with respect to the subject video parameters).

Generally, each pass through the while loop addresses a different videoparameter or combination of video parameters. For example, the firstpass may analyze the image resolution, the second pass may analyze theframe rate, and the third pass may analyze the compression factor.

As a specific example to illustrate the methods 100, the followingdiscussion details methods 100 in which the image resolution isanalyzed, then the frame rate, and then the compression factor. Thesemethods may include receiving an input video stream (Video_(in)), thebandwidth consumed by the input video stream (BW_(in)), the bandwidthlimit sourced from the user (BW_(max)), and the video parameter limitssourced from the user (Limits). For this example, the video parameterlimits include an image resolution limit, a frame rate limit, and acompression factor limit. For the sake of the example, the input videostream has a bandwidth that is greater than the bandwidth limit and atleast one of input video parameters does not conform to thecorresponding limit. Specifically, the input image resolution is greaterthan the image resolution limit, the input frame rate is greater thanthe frame rate limit, and/or the input compression factor is less thanthe compression factor limit. Not all input video streams to the videotransport system need to exceed the bandwidth limit. The systems andmethods of the present disclosure adapt to transmit an input videostream that complies with the bandwidth limit without modification ofthe video stream.

The while loop is entered because the bandwidth of the input videostream is greater than the bandwidth limit. In the first pass of thewhile loop (also referred to as a first stage of the method), thecalculating 102 compares the input image resolution of the input videostream to the image resolution limit. If the input image resolution isless than or equal to the image resolution limit, calculating 102 mayprovide a first-stage image resolution that is equal to the input imageresolution or may otherwise cause the while loop to iterate and/orindicate that the image resolution of the video stream 32 need not beadjusted. For example, calculating 102 may include determining thefirst-stage image resolution and providing the first-stage imageresolution as its output (the attribute 110). The determined first-stageimage resolution is less than or equal to the image resolution limit andis equal to either the input image resolution (because the input imageresolution is less than or equal to the image resolution limit) or, ifthe input image resolution is greater than the image resolution limit, ascaled image resolution.

The scaled image resolution is an image scale factor (a value less thanone) times the input image resolution. The image scale factor may becalculated using the input width, input height, and/or input pixelnumber corresponding to the input image resolution and the respectivewidth limit, height limit, and/or pixel number limit corresponding tothe image resolution limit. For example, the image scale factor may bethe minimum value of the ratio of the width limit to the input width,and the ratio of the image height limit to the input image height. Asanother example, the image scale factor may be the square root of theratio of the pixel number limit to the input pixel number. The imagescale factor may be further limited to one of several permitted values(e.g., an inverse integer) by selecting the largest permitted value thatis less than or equal to the initially calculated scale factor. Hence,the image scale factor that results from the calculating 102 of thefirst pass (i.e., the output attribute 110 of the first pass) times theinput image resolution results in an image resolution that is at mostequal to the image resolution limit.

Once the first-stage image resolution is determined, the first-stagebandwidth of the video stream 32 that would result or does result fromapplying the first-stage image resolution may be calculated. Thefirst-stage bandwidth is calculated based upon the first-stage imageresolution and the input frame rate as described herein. The first-stagebandwidth generally is calculated based upon a compression factor ofunity (no compression) so that compression may be applied only as neededin later stages. However, the first-stage bandwidth may be calculatedbased upon the input compression factor. The first-stage bandwidth maybe calculated based upon the bits per pixel in the input video stream.The first-stage bandwidth is presented as the bandwidth 108 and becomesthe input for the next pass of the while loop.

At the next pass of the while loop (the second stage of the method 100),the input bandwidth (the first-stage bandwidth) is compared with thebandwidth limit. Provided that the first-stage bandwidth is greater thanthe bandwidth limit, the calculating 102 compares the input frame rateof the input video stream (which is the same as the frame rate of theadjusted video stream 32 if adjusted in the first-stage) to the framerate limit. If the input frame rate is less than or equal to the framerate limit, calculating 102 may provide a second-stage frame rate thatis equal to the input frame rate or may otherwise cause the while loopto iterate and/or indicate that the frame rate of the video stream 32need not be adjusted. For example, calculating may include determiningthe second-stage frame rate and providing the second-stage frame rate asits output (the attribute 110). The determined second-stage frame rateis equal to either the input frame rate (because the input frame rate isless than or equal to the frame rate limit) or, if the input frame rateis greater than the frame rate limit, a transformed frame rate that isless than the input frame rate and greater than or equal to the framerate limit.

The transformed frame rate is a frame rate transformation factor (avalue less than one) times the input frame rate. The frame ratetransformation factor may be calculated using the bandwidth limit andthe first-stage bandwidth (which includes the first-stage imageresolution). For example, a preliminary frame rate transformation factormay be the ratio of the bandwidth limit to the first-stage bandwidth. Asanother example, the preliminary frame rate transformation factor may bethe ratio of the bandwidth limit to the product of the number of pixelscorresponding to the first-stage image resolution, the input frame rate,and the bits-per-pixel in the input video stream. The minimumtransformed frame rate is the frame rate limit. Hence, the frame ratetransformation factor is the maximum of the preliminary frame ratetransformation factor (e.g., as described above) and the ratio of theframe rate limit to the input frame rate. The transformed frame rate maybe further limited to one of several permitted values (e.g., an integernumber of frames per second) by selecting the largest permitted valuethat is less than or equal to the initially calculated transformed framerate and greater than or equal to the frame rate limit. Hence, thesecond-stage frame rate that results from the calculating 102 of thesecond pass (i.e., the output attribute 110 of the second pass) is atleast as great as the frame rate limit, unless the input frame rate isless than the frame rate limit.

Once the second-stage frame rate is determined, the second-stagebandwidth of the video stream 32 that would result or does result fromapplying the second-stage frame rate may be calculated. The second-stagebandwidth is calculated based upon the second-stage frame rate and thefirst-stage image resolution as described herein. The second-stagebandwidth generally is calculated based upon a compression factor ofunity (no compression) so that compression may be applied only as neededin later stages. However, the second-stage bandwidth may be calculatedbased upon the input compression factor. The second-stage bandwidth maybe calculated based upon the bits per pixel in the input video stream.The second-stage bandwidth is presented as the bandwidth 108 and becomesthe input for the next pass of the while loop.

At the next pass of the while loop (the third stage of the method 100),the input bandwidth (the second-stage bandwidth) is compared with thebandwidth limit. Provided that the second-stage bandwidth is greaterthan the bandwidth limit, the calculating 102 compares the inputcompression factor (or unity if the video stream is uncompressed or hasbeen decompressed during earlier steps) to the compression factor limit.If the input compression factor (or unity) is less than or equal to thecompression factor limit (which generally it will be if the methods 100do not include any further stages to adjust other video parameters),calculating 102 may provide a third-stage compression factor that isgreater than or equal to the ratio of the second-stage bandwidth to thebandwidth limit, and that is less than or equal to the compressionfactor limit. Additionally or alternatively, calculating 102 may providea third-stage compression factor conversion that is the ratio of thethird-stage compression factor to the input compression factor (orunity). The compression factor may be further limited to one of severalpermitted values (e.g., obtainable compression factors of the algorithmselected for compression of the video stream) by selecting the largestpermitted value that is less than or equal to the initially calculatedcompression ratio (and consequently less than or equal to thecompression factor limit).

After passing through these three stages, the method 100 of this exampleresults in video parameters (image resolution, frame rate, andcompression factor) that, when applied to the input video stream,produce a bandwidth-limited video stream with a bandwidth approximatelyequal to or less than the bandwidth limit.

Methods 100 may include adjusting 104 the input video stream to producethe bandwidth-limited video stream (Video_(out)) by applying the videoparameters calculated with the calculating 102. Adjusting 104 mayinclude operating and/or using the video adjustment modules 64 of FIG.2, such as the video scaling module 66, the video frame ratetransformation module 68, and/or the video compression module 70.

In the terms of the prior example, adjusting 104 may include scalingaccording to the first-stage image resolution, transforming frame rateaccording to the second-stage frame rate (if the first-stage bandwidthis greater than the bandwidth limit), and compressing according to thethird-stage compression factor (if the second-stage bandwidth is greaterthan the bandwidth limit). Adjusting 104 may include scaling the inputvideo stream to the first-stage image resolution to form a scaled videostream with the first-stage image resolution. If no more adjustment isneeded to satisfy the bandwidth limit, the scaled video stream may betransmitted as the bandwidth-limited video stream. Adjusting 104 mayinclude transforming the scaled video stream to the second-stage framerate to form a transformed video stream with the first-stage imageresolution and the second-stage frame rate. If no more adjustment isneeded to satisfy the bandwidth limit, the transformed video stream maybe transmitted as the bandwidth-limited video stream. Adjusting 104 mayinclude compressing the transformed video stream to the third-stagecompression factor to form the bandwidth-limited video stream with thefirst-stage image resolution, the second-stage frame rate, and thethird-stage compression factor.

FIG. 4 is a schematic representation of the video output device 26 ofthe video transport system 10. The video output device 26 includes avideo input port 52 and a video output port 54, and may include afacility to accept input from the user 12. For example, the video outputdevice 26 may include a user interface to interact with the user 12and/or a communications channel to receive specified output videoparameters. Additionally or alternatively, the video output device 26may communicate with the video destination 28 to receive specifiedoutput video parameters (e.g., preferred, compatible, and/or mandatoryvideo parameters for the operation of the video destination 28). In thevideo output device 26, the bandwidth-limited video streams 36 thatarrive at the video input port 52 are transferred (as optionallyprocessed) to the video output port 54. The video output device 26 mayinclude one or more video input ports 52 and/or one or more video outputports 54. Video streams 32 may be directed between any video input port52 and any video output port 54. Video streams 32 may be processedwithin the video output device 26, multiple video streams 32 may bemerged, and/or a video stream 32 may be replicated. Each video inputport 52 and each video output port 54 independently may be a physicalchannel (e.g., a wired or wireless connection) or may be a logical portwithin a communications channel that utilizes a physical channel. Forexample, all video input ports 52 may be logical ports in a singlecommunications channel. As another example, some video output ports 54may be logical ports in a single communications channel and differentvideo output ports 54 may be connected to different communicationschannels.

The outgoing, active, or selected output video stream 38 (e.g.,connected to the active or selected video destination 28) of the videooutput device 26 may change during operation of the video transportsystem 10. For example, two video destinations 28 with different videoparameters may be connected such that each may receive a respectiveoutput video stream 38. Either of the output video streams 38 may beselected as desired (e.g., by video output device 26 or by a switchdownstream of the video output device 26), resulting in varyingpreferred, compatible, and/or mandatory video parameters for acompatible output video stream 38. Generally, the video output device 26is configured to present the output video stream 38 with a fixed set (orsubset) of video parameters (e.g., the video parameters that arepreferable, compatible, and/or mandatory for a particular one or morevideo destinations 28).

The video parameters of the output video stream 38 typically aredetermined based on the video destination 28 and/or the video parametersof the input video stream 34. The video parameters of the output videostream 38 may not be affected by the video parameters of thebandwidth-limited video 36. The video output device 26 generally appliesvideo transformation to the bandwidth-limited video stream 36 tosubstantially reconstruct (or substantially restore) the input videostream 34 with video parameters that are compatible with the videodestination 28. Substantially reconstruct or restore in the context ofthe output video stream 38 means to reproduce the video content of theinput video stream 34 in a manner that is suitable for the videodestination 28 (e.g., have video parameters that are preferred,compatible, and/or mandatory for the video destination 28). In someembodiments, the substantially reconstructed or restored input videostream 34 (i.e., the output video stream 38 produced by the video outputdevice 26) may have the same video parameters as the input video stream34. The output video stream 38 may have lower quality than the inputvideo stream 34, in particular if the transformations of the video inputdevice 22 are not lossless and/or visually lossless.

The video output device 26 includes several modules to automaticallyadjust the video parameters of the bandwidth-limited video stream 36 andto transmit the output video stream 38 from the video output port 54.Modules include an output configuration module 80, an output restorationmodule 82, and at least one output video adjustment module 84 to adjustthe video parameters of the video stream.

As illustrated in the example of FIG. 4, the output video adjustmentmodules 84 may include modules dedicated to performing independentadjustment to the video content of the bandwidth-limited video stream36, for example, an output video decompression module 86 to decompressthe video stream, an output video frame rate transformation module 88 totransform the frame rate, and/or an output video scaling module 90 toscale the image resolution. Output video adjustment modules 84 mayadjust one or more video parameters. Different output video adjustmentmodules 84 may each adjust different video parameters. Additionally oralternatively, two output video adjustment modules 84 may adjust thesame video parameter (typically in different manners or in conjunctionwith different combinations of video parameters).

Generally, the output video adjustment modules 84 operate to transformthe same video parameters that the video input device 22 may operate on.Further, the output video adjustment modules 84 are configured andoperated to generally invert the transformations applied by the videoinput device 22. For example, the output video adjustment modules 84 inFIG. 4 are arranged to decompress, frame rate transform, and scale thevideo content (the same transformations applied by the video adjustmentmodules 64 of the video input device 22 of FIG. 2). Additionally, theoutput video adjustment modules 84 of FIG. 4 are arranged in the inverseorder of the video adjustment modules 64 of FIG. 2. Thus, the videotransport system 10 may be configured to transform the input videostream 34 into the bandwidth-limited video stream 36 by first scaling(if necessary), next frame rate transforming (if necessary), and thencompressing (if necessary). The video transport system 10 may thentransform the bandwidth-limited video stream 36 into the output videostream 38 by first decompressing (if necessary), next frame ratetransforming (if necessary), and then scaling (if necessary). Like thevideo adjustment modules 64, each output video adjustment module 84operates on a video stream input to that module, which may be referredto as a module operand video stream and a module input video stream.

The output video adjustment modules 84 are cascaded such that the outputvideo adjustment modules 84 operate (if needed) in series on thebandwidth-limited video stream 36 to produce the output video stream 38.Thus, a module may be referred to as being upstream or downstream ofother modules, with upstream modules closer to the video input port 52and downstream modules closer to the video output port 54. Though themost upstream of the output video adjustment modules 84 may operate onthe bandwidth-limited video stream 36, the bandwidth-limited videostream 36 may be adjusted, buffered, filtered, or otherwise operated onprior to transmission to the most upstream of the output videoadjustment modules 84 (no direct connection between the video input port52 and the most upstream module is necessary). Though the mostdownstream of the output video adjustment modules 84 may produce theoutput video stream 38, the video stream output from the most downstreamof the output video adjustment modules 84 may be adjusted, buffered,filtered, compressed, or otherwise operated on prior to presentation atthe video output port 54 (no direct connection between the video outputport 54 and the most downstream of the output video adjustment modules84 is necessary).

The output video decompression module 86 is configured to decompress theoperand video stream input to the module to produce an uncompressedvideo stream at the output of the module. As illustrated in the exampleof FIG. 4, the video stream input to the video compression module 86generally is the bandwidth-limited video stream 36. Algorithms todecompress the operand video stream include the decompression algorithmsassociated with the examples of compression algorithms. One of skill inthe art recognizes how to select and apply a suitable decompressionalgorithm to decompress a given compressed video stream.

The output video frame rate transformation module 88 is configured toapply a frame rate transformation factor to the operand video streaminput to the module to produce a frame-expanded video stream at theoutput of the module. The frame-expanded video stream has a transformedframe rate that is generally greater the frame rate of the operand videostream. The transformed frame rate may be the frame rate of the inputvideo stream 34 and/or the preferred, compatible, and/or mandatory framerate of the video destination 28. Algorithms to increase the frame rateinclude replicating frames and interpolating between frames. The outputvideo frame rate transformation module 88 may be configured to produce aframe-reduced video stream at the output of the module.

The output video scaling module 90 is configured to apply an image scalefactor to the operand video stream input to the module to produce ascaled video stream at the output of the module. The output videoscaling module 90 is generally configured to increase the imageresolution of the video stream as it is passed through the module.Hence, the image scale factor is typically a value greater than one.Algorithms to increase the image resolution include replication,interpolation (e.g., bilinear, bicubic, etc.), resampling (e.g., Lanczosresampling).

The output configuration module 80 of the video output device 26 may beconfigured to receive a selection of target output video parameters thatare preferred, compatible, and/or mandatory (or otherwise suitable) forthe output video stream 38 and/or the video destination 28. The outputconfiguration module 80 may be configured to determine the target outputvideo parameters based upon the video parameters, quality, and/orcontent type of the input video stream 34 (as communicated by the videoinput device 22, e.g., in the bandwidth-limited video stream 36 and/orvia an alternate communications channel, and/or by the user 12).Additionally or alternatively, the output configuration module 80 may beconfigured to determine the target video parameters based uponcommunication with the video destination 28. The output configurationmodule 80 may include a user interface to interact with the user 12.

The output restoration module 82 of the video output device 26 isconfigured to control the operation of the output video adjustmentmodules 84 and the routing of the video stream through the video outputdevice 26. The output restoration module 82 is configured to determineif the bandwidth-limited video stream 36 needs to be adjusted to meetthe target output video parameters of the output video stream 38. Theoutput restoration module 82 may be configured to apply the output videoadjustment modules 84 in the order and with suitable transformationparameters to substantially reconstruct the input video stream 34 fromthe bandwidth-limited video stream 36. If the transformations of thevideo input device 22 are lossless or visually lossless, thereconstruction may produce the same video content as the input videostream 34 or may produce video content that is visuallyindistinguishable from the video content of the input video stream 34.

FIG. 5 schematically represents a computerized system 200 that may beused to implement and/or instantiate video transport system 10 andcomponents thereof, such as video source 20, video input device 22,video output device 26, video destination 28, configuration module 60,bandwidth limiting module 62, video adjustment modules 64, video scalingmodule 66, video frame rate transformation module 68, video compressionmodule 70, input conditioning module 72, output configuration module 80,output restoration module 82, output video adjustment modules 84, outputvideo decompression module 86, output video frame rate transformationmodule 88, and output video scaling module 90. The computerized system200 includes a processing unit 202 that may be operatively coupled to acomputer-readable memory 206 by a communications infrastructure 210. Theprocessing unit 202 may include one or more computer processors 204 andmay include a distributed group of computer processors 204. Theprocessing unit 202 may include, or be implemented on, programmable,reconfigurable, and/or dedicated hardware such as field-programmablegate arrays, digital signal processors, and/or application specificintegrated circuits.

The computerized system 200 also may include a computer-readable storagemedia assemblage 212 that is operatively coupled to the processing unit202 and/or the computer-readable memory 206, e.g., by communicationsinfrastructure 210. The computer-readable storage media assemblage 212may include one or more non-transitory computer-readable storage media214 and may include a distributed group of non-transitorycomputer-readable storage media 214.

The communications infrastructure 210 may include a local data bus, acommunication interface, and/or a network interface. The communicationsinfrastructure 210 may be configured to transmit and/or to receivesignals, such as electrical, electromagnetic, optical, and/or acousticsignals. The communication infrastructure 210 may include the videoinput port 42 and/or the video output port 44. Additionally oralternatively, the video input port 42 and/or the video output port 44may be logical ports within a communications protocol (e.g., a networkcommunications protocol).

The computerized system 200 may include one or more input-output devices216 operatively coupled to the processing unit 202, thecomputer-readable memory 206, and/or the computer-readable storage mediaassemblage 212. Input-output devices 216 are generally configured foruser interaction and may be configured for visual, audio, and/or tactileinput and/or output. Each input-output device 216 independently may beconfigured for only input, only output, primarily input, primarilyoutput, and/or a combination of input and output. Examples ofinput-output devices 216 include monitors (e.g., video monitor),displays (e.g., alphanumeric displays, lamps, and/or LEDs), keyboards,pointing devices (e.g., mice), touch screens, speakers, and buzzers.

The computerized system 200 may include a distributed group ofcomputers, servers, workstations, etc., which each may be interconnecteddirectly or indirectly (including by network connection). Thus, thecomputerized system 200 may include one or more processing units 202,computer-readable memories 206, computer-readable storage mediaassemblages 212, and/or input-output devices 216 that are locatedremotely from one another.

One or both of the computer-readable memory 206 and thecomputer-readable storage media assemblage 212 include control logic 220and/or data 222. Control logic 220 (which may also be referred to assoftware, firmware, gateware, and/or hardware) may include instructionsthat, when executed by the processing unit 202, cause the computerizedsystem 200 to perform one or more of the methods described herein.Control logic 220 may include one or more of the configuration module60, bandwidth limiting module 62, video adjustment modules 64, videoscaling module 66, video frame rate transformation module 68, videocompression module 70, input conditioning module 72, outputconfiguration module 80, output restoration module 82, output videoadjustment modules 84, output video decompression module 86, outputvideo frame rate transformation module 88, and output video scalingmodule 90. Data 222 may include the video parameter limits, input videoparameters, bandwidth-limited video parameters, and/or data associatedwith the modules and/or methods described herein.

Where devices, modules, and/or methods are described as performing oneor more functions, the respective device and/or module is configured,e.g., programmed, to perform the function(s). The respective deviceand/or module may include one or more programs, agents, services, and/orcomponents configured, e.g., programmed, to perform the function(s) whenthe programs, agents, services, and/or components are executed by theprocessing unit 202 or otherwise operated by the computerized system200. The control logic 220 and/or data 222 may include instructionsand/or information corresponding to the programs, agents, services,and/or components.

Examples of inventive subject matter according to the present disclosureare described in the following enumerated paragraphs.

A1. A method for enforcing a bandwidth limit in a bandwidth-limitedvideo transport system, the method comprising:

receiving from a user a selection of an image resolution limit, a framerate limit, and a compression factor limit;

receiving a bandwidth limit or alternatively calculating a bandwidthlimit based upon the image resolution limit, the frame rate limit, andthe compression factor limit;

receiving an input video stream that has an input image resolution, aninput frame rate, and an input compression factor, and wherein at leastone of the input image resolution is greater than the image resolutionlimit, the input frame rate is greater than the frame rate limit, andthe input compression factor is less than the compression factor limit;

determining a first-stage image resolution that is less than or equal tothe image resolution limit, wherein the first-stage image resolution isequal to either the input image resolution or, if the input imageresolution is greater than the image resolution limit, a scaled imageresolution that is an image scale factor times the input imageresolution;

calculating a first-stage bandwidth based upon the first-stage imageresolution and the input frame rate, and optionally the inputcompression factor;

provided that the first-stage bandwidth is greater than the bandwidthlimit:

-   -   determining a second-stage frame rate that is equal to either        the input frame rate or, if the input frame rate is greater than        the frame rate limit, a transformed frame rate that is a frame        rate transformation factor times the input frame rate and that        is greater than or equal to the frame rate limit;    -   calculating a second-stage bandwidth based upon the first-stage        image resolution and the second-stage frame rate, and optionally        the input compression factor; and    -   provided that the second-stage bandwidth is greater than the        bandwidth limit, determining a third-stage compression factor        that is greater than or equal to a ratio of the second-stage        bandwidth to the bandwidth limit, and is less than or equal to        the compression factor limit; and

adjusting the input video stream to produce a bandwidth-limited videostream by scaling according to the first-stage image resolution,transforming frame rate according to the second-stage frame rate,provided that the first-stage bandwidth is greater than the bandwidthlimit, and compressing according to the third-stage compression factor,provided that the second-stage bandwidth is greater than the bandwidthlimit.

A1.1. The method of paragraph A1, wherein the receiving the input videostream and adjusting the input video stream are performed with a videoinput device of the bandwidth-limited video transport system.

A2. The method of any of paragraphs A1-A1.1, wherein the input videostream is an uncompressed video stream with the input compression factorbeing unity.

A3. The method of any of paragraphs A1-A2, wherein receiving the inputvideo stream includes receiving a compressed video stream with acompression factor greater than unity and decompressing the compressedvideo stream to form the input video stream with the input compressionfactor being unity.

A4. The method of any of paragraphs A1-A3, further comprisingdetermining that an input bandwidth of the input video stream is greaterthan the bandwidth limit.

A5. The method of any of paragraphs A1-A4, wherein the first-stagebandwidth is greater than the bandwidth limit and optionally wherein thesecond-stage bandwidth is greater than the bandwidth limit.

A6. The method of any of paragraphs A1-A5, wherein the image resolutionlimit includes an image width limit and an image height limit, whereinthe input image resolution includes an input image width and an inputimage height, and wherein determining the first-stage image resolutionincludes determining the image scale factor by calculating a minimumvalue of a ratio of the image width limit to the input image width and aratio of the image height limit to the input image height.

A7. The method of any of paragraphs A1-A6, wherein the image resolutionlimit includes a pixel number limit and the input image resolutionincludes an input pixel number, and wherein the determining thefirst-stage image resolution includes determining the image scale factorby calculating a square root of a ratio of the pixel number limit to theinput pixel number.

A8. The method of any of paragraphs A1-A7, wherein the determining thesecond-stage frame rate includes determining the frame ratetransformation factor by calculating a ratio of the bandwidth limit tothe first-stage bandwidth.

A9. The method of any of paragraphs A1-A8, wherein the input videostream has an input bits-per-pixel, wherein the first-stage imageresolution includes a first-stage pixel number, wherein the determiningthe second-stage frame rate includes determining the frame ratetransformation factor by calculating a ratio of the bandwidth limit to aproduct of the first-stage pixel number, the input frame rate, and theinput bits-per-pixel.

A10. The method of any of paragraphs A1-A9, wherein the adjusting theinput video stream includes scaling the input video stream to thefirst-stage image resolution to form a scaled video stream with thefirst-stage image resolution, and optionally wherein the scaled videostream is the bandwidth-limited video stream.

A10.1. The method of paragraph A10, wherein the adjusting the inputvideo stream includes transforming the scaled video stream to thesecond-stage frame rate to form a transformed video stream with thefirst-stage image resolution and the second-stage frame rate, andoptionally wherein the transformed video stream is the bandwidth-limitedvideo stream.

A10.1.1. The method of paragraph A10.1, wherein the adjusting the inputvideo stream includes compressing the transformed video stream to thethird-stage compression factor to form the bandwidth-limited videostream with the first-stage image resolution, the second-stage framerate, and the third-stage compression factor.

A11. The use of a video input device of a bandwidth-limited videotransport system to perform the method of any of paragraphs A1-A10.1.1.

A12. A bandwidth-limited video transport system comprising:

a computer-readable memory;

a processing unit operatively coupled to the computer-readable memory;and

a computer-readable storage media assemblage, wherein thecomputer-readable storage media assemblage is operatively coupled to thecomputer-readable memory and includes instructions that, when executedby the processing unit, cause the system to perform the method of any ofparagraphs A1-A10.1.1.

B1. A method for enforcing a bandwidth limit in a bandwidth-limitedvideo transport system, the method comprising:

receiving from a user a selection of an image resolution limit, a framerate limit, and a compression factor limit;

receiving a bandwidth limit or alternatively calculating a bandwidthlimit based upon the image resolution limit, the frame rate limit, andthe compression factor limit;

receiving an input video stream that has an input image resolution, aninput frame rate, and an input compression factor, and wherein at leastone of the input image resolution is greater than the image resolutionlimit, the input frame rate is greater than the frame rate limit, andthe input compression factor is less than the compression factor limit;and

reducing a bandwidth of the input video stream to produce abandwidth-limited video stream by at least one of:

-   -   determining that the input video stream has an input bandwidth        that is greater than the bandwidth limit and that the input        image resolution is greater than the image resolution limit,        determining a first-stage image resolution that is less than or        equal to the image resolution limit and that is an image scale        factor times the input image resolution, calculating a        first-stage bandwidth based upon the first-stage image        resolution and the input frame rate, and optionally the input        compression factor, and scaling the input video stream according        to the first-stage image resolution to produce a scaled video        stream;    -   determining that the first-stage bandwidth is greater than the        bandwidth limit and that the input frame rate is greater than        the frame rate limit, determining a second-stage frame rate that        is less than or equal to the frame rate limit and that is a        frame rate transformation factor times the input frame rate,        calculating a second-stage bandwidth based upon the first-stage        image resolution and the second-stage frame rate, and optionally        the input compression factor, and transforming the scaled video        stream to the second-stage frame rate to produce a scaled,        transformed video stream;    -   determining that the second-stage bandwidth is greater than the        bandwidth limit, determining a third-stage compression factor        that is greater than or equal to a ratio of the second-stage        bandwidth to the bandwidth limit and that is less than or equal        to the compression factor limit, and compressing the scaled,        transformed video stream according to the third-stage        compression factor to produce the bandwidth-limited video stream        that has a bandwidth less than the bandwidth limit.

B1.1. The method of paragraph B1, wherein receiving the input videostream and reducing the bandwidth of the input video stream areperformed with a video input device of the bandwidth-limited videotransport system.

B2. The method of any of paragraphs B1-B1.1, wherein the input videostream is an uncompressed video stream with the input compression factorbeing unity.

B3. The method of any of paragraphs B1-B2, wherein receiving the inputvideo stream includes receiving a compressed video stream with acompression factor greater than unity and decompressing the compressedvideo stream to form the input video stream with the input compressionfactor being unity.

B4. The method of any of paragraphs B1-B3, wherein the image resolutionlimit includes an image width limit and an image height limit, whereinthe input image resolution includes an input image width and an inputimage height, and wherein determining the first-stage image resolutionincludes determining the image scale factor by calculating a minimumvalue of a ratio of the image width limit to the input image width and aratio of the image height limit to the input image height.

B5. The method of any of paragraphs B1-B4, wherein the image resolutionlimit includes a pixel number limit and the input image resolutionincludes an input pixel number, and wherein the determining thefirst-stage image resolution includes determining the image scale factorby calculating a square root of a ratio of the pixel number limit to theinput pixel number.

B6. The method of any of paragraphs B1-B5, wherein the determining thesecond-stage frame rate includes determining the frame ratetransformation factor by calculating a ratio of the bandwidth limit tothe first-stage bandwidth.

B7. The method of any of paragraphs B1-B6, wherein the input videostream has an input bits-per-pixel, wherein the first-stage imageresolution includes a first-stage pixel number, wherein the determiningthe second-stage frame rate includes determining the frame ratetransformation factor by calculating a ratio of the bandwidth limit to aproduct of the first-stage pixel number, the input frame rate, and theinput bits-per-pixel.

B8. The use of a video input device of a bandwidth-limited videotransport system to perform the method of any of paragraphs B1-B7.

B9. A bandwidth-limited video transport system comprising:

a computer-readable memory;

a processing unit operatively coupled to the computer-readable memory;and

a computer-readable storage media assemblage, wherein thecomputer-readable storage media assemblage is operatively coupled to thecomputer-readable memory and includes instructions that, when executedby the processing unit, cause the system to perform the method of any ofparagraphs B1-B7.

C1. A video input device in a bandwidth-limited video transport system,the video input device comprising:

a video input port, configured to receive an input video stream that hasan input image resolution, an input frame rate, an input compressionfactor, and an input bandwidth;

a video output port, configured to transmit a bandwidth-limited videostream;

a configuration module, programmed to receive a selection of an imageresolution limit, a frame rate limit, and a compression factor limit,wherein the configuration module is programmed to perform at least oneof (a) receive a selection of a bandwidth limit and (b) determine thebandwidth limit based upon the image resolution limit, the frame ratelimit, and the compression factor limit;

a video scaling module, programmed to apply an image scale factor to ascaling operand video stream to produce a scaled video stream, whereinthe scaled video stream has a scaled image resolution that is the imagescale factor times an image resolution of the scaling operand videostream;

a video frame rate transformation module, programmed to apply a framerate transformation factor to a frame-transformation operand videostream to produce a frame-reduced video stream, wherein theframe-reduced video stream has a transformed frame rate that is theframe rate transformation factor times a frame rate of theframe-transformation operand video stream;

a video compression module, programmed to apply a compression factorconversion to a compression operand video stream to produce a compressedvideo stream, wherein the compressed video stream has a compressedcompression factor that is the compression factor conversion times acompression factor of the compression operand video stream; and

a bandwidth limiting module, programmed to determine if the inputbandwidth of the input video stream is greater than the bandwidth limitand to limit the input bandwidth of the input video stream by:

-   -   determining a first-stage image resolution that is less than or        equal to the image resolution limit, wherein the first-stage        image resolution is equal to either the input image resolution        or, if the input image resolution is greater than the image        resolution limit, the scaled image resolution that is the image        scale factor times the input image resolution;    -   calculating a first-stage bandwidth based upon the first-stage        image resolution and the input frame rate, and optionally the        input compression factor;    -   provided that the first-stage bandwidth is greater than the        bandwidth limit:        -   determining a second-stage frame rate that is equal to            either the input frame rate or, if the input frame rate is            greater than the frame rate limit, the transformed frame            rate that is the frame rate transformation factor times the            input frame rate and that is greater than or equal to the            frame rate limit;        -   calculating a second-stage bandwidth based upon the            first-stage image resolution and the second-stage frame            rate, and optionally the input compression factor; and        -   provided that the second-stage bandwidth is greater than the            bandwidth limit, determining a third-stage compression            factor that is greater than or equal to a ratio of the            second-stage bandwidth and the bandwidth limit, and is less            than or equal to the compression factor limit; and        -   adjusting the input video stream to produce the            bandwidth-limited video stream by scaling according to the            first-stage image resolution with the video scaling module,            transforming frame rate according to the second-stage frame            rate with the video frame rate transformation module,            provided that the first-stage bandwidth is greater than the            bandwidth limit, and compressing according to the            third-stage compression factor with the video compression            module, provided that the second-stage bandwidth is greater            than the bandwidth limit.

C2. The video input device of paragraph C1 programmed to perform themethod of any of paragraphs A1-A10.1.1 or any of paragraphs B1437.

C3. The video input device of any of paragraphs C1-C2, furthercomprising a computer-readable memory, a processing unit operativelycoupled to the computer-readable memory, and a computer-readable storagemedia assemblage, wherein the computer-readable storage media assemblageis operatively coupled to the computer-readable memory and includes theconfiguration module, the video scaling module, the video frame ratetransformation module, the video compression module, and the bandwidthlimiting module.

C4. A bandwidth-limited video transport system comprising:

the video input device of any of paragraphs C1-C3; and

a video output device connected to the video input device by abandwidth-limited link, wherein the video output device comprises:

-   -   an output device video input port, configured to receive the        bandwidth-limited video stream from the video input device via        the bandwidth-limited link;    -   an output device video output port, configured to transmit an        output video stream configured for reception by a video        destination;    -   an output video decompression module, programmed to decompress        the bandwidth-limited video stream to produce an uncompressed        video stream;    -   an output frame rate transformation module, programmed to apply        an output frame rate transformation factor to the uncompressed        video stream to produce an uncompressed, frame-transformed video        stream; and    -   an output video scaling module, programmed to apply an output        image scale factor to the uncompressed, frame-transformed video        stream to produce the output video stream.

C4.1. The system of paragraph C4, wherein the video output devicefurther comprises an output restoration module that is programmed todetermine the output frame rate transformation factor based on a framerate of the bandwidth-limited video stream and a selected frame rate ofthe video destination, and optionally wherein the frame rate of thebandwidth-limited video stream is the second-stage frame rate.

C4.2. The system of any of paragraphs C4-C4.1, wherein the video outputdevice further comprises an/the output restoration module that isprogrammed to determine the output image scale factor based on an imageresolution of the bandwidth-limited video stream and a selected imageresolution of the video destination, and optionally wherein the imageresolution of the bandwidth-limited video stream is the first-stageimage resolution.

C4.3. The system of any of paragraphs C4-C4.2, wherein the video inputdevice is programmed to transmit input quality information to the videooutput device, wherein the input quality information includes at leastone of the input image resolution, the input frame rate, the inputcompression factor, and the input bandwidth, wherein the video outputdevice is programmed to receive the input quality information from thevideo input device.

C4.3.1. The system of paragraph C4.3, wherein the video output devicefurther comprises an/the output restoration module that is programmed todetermine the output frame rate transformation factor based on the inputframe rate.

C4.3.2. The system of any of paragraphs C4.3-C4.3.1, wherein the videooutput device further comprises an/the output restoration module that isprogrammed to determine the output image scale factor based on the inputimage resolution.

As used herein, the terms “adapted” and “configured” mean that theelement, component, or other subject matter is designed and/or intendedto perform a given function. Thus, the use of the terms “adapted” and“configured” should not be construed to mean that a given element,component, or other subject matter is simply “capable of” performing agiven function but that the element, component, and/or other subjectmatter is specifically selected, created, implemented, utilized,programmed, and/or designed for the purpose of performing the function.It is also within the scope of the present disclosure that elements,components, and/or other recited subject matter that is recited as beingadapted to perform a particular function may additionally oralternatively be described as being configured to perform that function,and vice versa. Similarly, subject matter that is recited as beingconfigured to perform a particular function may additionally oralternatively be described as being operative to perform that function.

As used herein, the phrase, “for example,” the phrase, “as an example,”and/or simply the term “example,” when used with reference to one ormore components, features, details, structures, embodiments, and/ormethods according to the present disclosure, are intended to convey thatthe described component, feature, detail, structure, embodiment, and/ormethod is an illustrative, non-exclusive example of components,features, details, structures, embodiments, and/or methods according tothe present disclosure. Thus, the described component, feature, detail,structure, embodiment, and/or method is not intended to be limiting,required, or exclusive/exhaustive; and other components, features,details, structures, embodiments, and/or methods, including structurallyand/or functionally similar and/or equivalent components, features,details, structures, embodiments, and/or methods, are also within thescope of the present disclosure.

As used herein, the phrases “at least one of” and “one or more of,” inreference to a list of more than one entity, means any one or more ofthe entities in the list of entities, and is not limited to at least oneof each and every entity specifically listed within the list ofentities. For example, “at least one of A and B” (or, equivalently, “atleast one of A or B,” or, equivalently, “at least one of A and/or B”)may refer to A alone, B alone, or the combination of A and B.

As used herein, the singular forms “a”, “an” and “the” may be intendedto include the plural forms as well, unless the context clearlyindicates otherwise.

In the event that any patents, patent applications, or other referencesare incorporated by reference herein and (1) define a term in a mannerthat is inconsistent with and/or (2) are otherwise inconsistent with,either the non-incorporated portion of the present disclosure or any ofthe other incorporated references, the non-incorporated portion of thepresent disclosure shall control, and the term or incorporateddisclosure therein shall only control with respect to the reference inwhich the term is defined and/or the incorporated disclosure was presentoriginally.

INDUSTRIAL APPLICABILITY

The systems and methods disclosed herein are applicable to thecommunication, entertainment, and video production industries.

The various disclosed elements of systems and steps of methods disclosedherein are not required of all systems and methods according to thepresent disclosure, and the present disclosure includes all novel andnon-obvious combinations and subcombinations of the various elements andsteps disclosed herein. Moreover, any of the various elements and steps,or any combination of the various elements and/or steps, disclosedherein may define independent inventive subject matter that is separateand apart from the whole of a disclosed system or method. Accordingly,such inventive subject matter is not required to be associated with thespecific systems and methods that are expressly disclosed herein, andsuch inventive subject matter may find utility in systems and/or methodsthat are not expressly disclosed herein.

It is believed that the following claims particularly point out certaincombinations and subcombinations that are directed to one of thedisclosed inventions and are novel and non-obvious. Inventions embodiedin other combinations and subcombinations of features, functions,elements and/or properties may be claimed through amendment of thepresent claims or presentation of new claims in this or a relatedapplication. Such amended or new claims, whether they are directed to adifferent invention or directed to the same invention, whetherdifferent, broader, narrower, or equal in scope to the original claims,are also regarded as included within the subject matter of theinventions of the present disclosure.

The invention claimed is:
 1. A method for enforcing a bandwidth limit ina bandwidth-limited video transport system, the method comprising:receiving, by a configuration module, from a user device a selectedimage resolution limit, a selected frame rate limit, and a selectedcompression factor limit; determining, by a bandwidth limiting module,the bandwidth limit based upon the selected image resolution limit, theselected frame rate limit, and the selected compression factor limit;receiving, by a video input port, an input video stream that has aninput image resolution, an input frame rate, and an input compressionfactor; responsive to receiving the input video stream, determining, bythe bandwidth limiting module, whether the input image resolution isless than or equal to the selected image resolution limit or is greaterthan the selected image resolution limit; in response to the input imageresolution being greater than the selected image resolution limit,multiplying, by the bandwidth limiting module, the input imageresolution by an image scale factor less than one to create a reducedinput image resolution; calculating, by the bandwidth limiting module, afirst-stage bandwidth that is less than a bandwidth of the input videostream based upon the reduced input image resolution; scaling, by avideo scaling module, the input video stream according to the reducedinput image resolution to produce a scaled video stream; determining, bythe bandwidth limiting module, that the first-stage bandwidth is stillgreater than the bandwidth limit; determining, by the bandwidthlimitation module, the input frame rate is greater than the selectedframe rate and the input compression factor is less than the selectedcompression factor limit; responsive to determining the first-stagebandwidth is still greater than the bandwidth limit and the input framerate is greater than the selected frame rate limit and the inputcompression factor is less than the selected compression factor limit,selecting, by the bandwidth limiting module, the input frame rate andthe input compression factor to be modified to adjust the first-stagebandwidth; and calculating and modifying, by the bandwidth limitingmodule, both the input frame rate and the input compression factor inpredetermined order a second-stage bandwidth based upon the reducedinput image resolution, wherein the predetermined order is performed bycalculating and modifying the input frame rate before calculating andmodifying the input compression factor.
 2. The method of claim 1,wherein receiving the input video stream includes receiving a compressedvideo stream with a compression factor greater than unity anddecompressing the compressed video stream to form the input video streamwith the input compression factor being unity.
 3. The method of claim 1,wherein the selected image resolution limit includes an image widthlimit and an image height limit, wherein the input image resolutionincludes an input image width and an input image height, and whereindetermining the reduced input image resolution includes determining theimage scale factor by calculating a minimum value of a ratio of theimage width limit to the input image width and a ratio of the imageheight limit to the input image height.
 4. The method of claim 1,wherein the selected image resolution limit includes a pixel numberlimit and the input image resolution includes an input pixel number, andwherein the determining the reduced input image resolution includesdetermining the image scale factor by calculating a square root of aratio of the pixel number limit to the input pixel number.
 5. The methodof claim 1, wherein the determining the modified input frame rateincludes determining a frame rate transformation factor by calculating aratio of the bandwidth limit to the first-stage bandwidth.
 6. The methodof claim 1, wherein the input video stream has an input bits-per-pixel,wherein the reduced input image resolution includes a first-stage pixelnumber, wherein the determining the modified input frame rate includesdetermining the frame rate transformation factor by calculating a ratioof the bandwidth limit to a product of the first-stage pixel number, theinput frame rate, and the input bits-per-pixel.
 7. The method of claim1, wherein receiving the input video stream and determining thefirst-stage bandwidth are performed with a video input device of thebandwidth-limited video transport system.
 8. A method for enforcing abandwidth limit in a bandwidth-limited video transport system, themethod comprising: receiving, by a configuration module, from a userdevice a selected image resolution limit, a selected a frame rate limit,and a selected compression factor limit; determining, by a bandwidthlimiting module, the bandwidth limit based upon the selected imageresolution limit, selected the frame rate limit, and the selectedcompression factor limit; receiving, by a video input port, an inputvideo stream that has an input image resolution, an input frame rate,and an input compression factor; responsive to receiving the input videostream, determining, by the bandwidth limiting module, whether the inputimage resolution is less than or equal to the selected image resolutionlimit or is greater than the selected image resolution limit; inresponse to the input image resolution is greater than the imageresolution limit, multiplying, by the bandwidth limiting module, theinput image resolution by an image scale factor less than one to createa reduced input image resolution; calculating, by the bandwidth limitingmodule, a first-stage bandwidth that is less than a bandwidth of theinput video stream based upon the reduced input image resolution;determining, by the bandwidth limiting module, that the first-stagebandwidth is still greater than the bandwidth limit; determining, by thebandwidth limiting module, the input frame rate is greater than theselected frame rate limit and the input compression factor is less thanthe selected compression factor limit; responsive to determining thefirst-stage bandwidth is still greater than the bandwidth limit and theinput frame rate is greater than the selected frame rate limit and theinput compression factor is less than the selected compression factorlimit, modifying, by the bandwidth limiting module, the input frame rateand the input compression factor to adjust the first-stage bandwidth;and calculating and modifying, by the bandwidth limiting module, boththe input frame rate and the input compression factor in predeterminedorder a second-stage bandwidth based upon the reduced input imageresolution, wherein the predetermined order is performed by calculatingand modifying the input frame rate before calculating and modifying theinput compression factor.
 9. The method of claim 8, wherein the inputvideo stream is an uncompressed video stream with the input compressionfactor being unity.
 10. The method of claim 8, wherein receiving theinput video stream includes receiving a compressed video stream with acompression factor greater than unity and decompressing the compressedvideo stream to form the input video stream with the input compressionfactor being unity.
 11. The method of claim 8, further comprisingdetermining that bandwidth of the input video stream is greater than thebandwidth limit, and wherein the first-stage bandwidth is greater thanthe bandwidth limit and the second-stage bandwidth is greater than thebandwidth limit.
 12. The method of claim 8, wherein the selected imageresolution limit includes an image width limit and an image heightlimit, wherein the input image resolution includes an input image widthand an input image height, and wherein determining the reduced inputimage resolution includes determining the image scale factor bycalculating a minimum value of a ratio of the image width limit to theinput image width and a ratio of the image height limit to the inputimage height.
 13. The method of claim 8, wherein the selected imageresolution limit includes a pixel number limit and the input imageresolution includes an input pixel number, and wherein the determiningthe reduced input image resolution includes determining the image scalefactor by calculating a square root of a ratio of the pixel number limitto the input pixel number.
 14. The method of claim 8, wherein thedetermining the modified input frame rate includes determining a framerate transformation factor by calculating a ratio of the bandwidth limitto the first-stage bandwidth.
 15. The method of claim 8, wherein theinput video stream has an input bits-per-pixel, wherein the reducedinput image resolution includes a first-stage pixel number, wherein thedetermining the modified input frame rate includes determining the framerate transformation factor by calculating a ratio of the bandwidth limitto a product of the first-stage pixel number, the input frame rate, andthe input bits-per-pixel.
 16. The method of claim 8, further comprising:scaling the input video stream according to the reduced input imageresolution to form a scaled video stream.
 17. The method of claim 16,wherein the scaling the input video stream further includes transformingthe scaled video stream to the modified input frame rate to form atransformed video stream with the reduced input image resolution. 18.The method of claim 17, wherein the scaling the input video streamfurther includes compressing the scaled transformed video stream to themodified compression factor to form the transformed video stream withthe reduced input image resolution, the modified frame rate, and themodified compression factor.
 19. A video input device in abandwidth-limited video transport system, the video input devicecomprising: a video input port that receives an input video stream thathas an input image resolution, an input frame rate, an input compressionfactor, and an input bandwidth; a video output port that transmits abandwidth-limited video stream; a configuration module including aprocessor that receives a selected image resolution limit, a selectedframe rate limit, and a selected compression factor limit, wherein theconfiguration module determines a bandwidth limit based upon theselected image resolution limit, the selected frame rate limit, and theselected compression factor limit; a video scaling module that appliesan image scale factor to the input video stream to produce a scaledvideo stream, wherein the scaled video stream has a scaled imageresolution that is based on the image scale factor times the input imageresolution of the input video stream; a video frame rate transformationmodule that applies a frame rate transformation factor to the inputvideo stream to produce a frame-reduced video stream, wherein theframe-reduced video stream has a transformed frame rate that is theframe rate transformation factor times the input frame rate of the inputvideo stream; a video compression module that applies a compressionfactor conversion to the input video stream to produce a compressedvideo stream, wherein the compressed video stream has a compressionfactor conversion that is based on the compression factor; and abandwidth limiting module that determines whether the input bandwidth ofthe input video stream is greater than the bandwidth limit; in responseto the input bandwidth of the input video stream is greater than thebandwidth limit, the bandwidth limiting module: multiply multiples theinput image resolution by an image scale factor less than one to createa reduced input image resolution, calculates a first-stage bandwidththat is less than a bandwidth of the input video stream based upon thereduced input image resolution, determines that the first-stagebandwidth is still greater than the bandwidth limit, determines theinput frame rate is greater than the selected frame rate limit and theinput compression factor is less than the compression factor limit,modifies the input frame rate and the input compression factor to adjustthe first-stage bandwidth in response to the first-stage bandwidth beinggreater than the bandwidth limit and the input frame rate being greaterthan the selected frame rate limit and the input compression factorbeing less than the selected compression factor limit, and calculatesand modifies a bandwidth-limited video stream based upon the reducedinput image resolution, the transformed frame rate and the inputcompression factor in a predetermined order, wherein the predeterminedorder is performed by calculating and modifying the transformed framerate before calculating and modifying the input compression factor. 20.A bandwidth-limited video transport system comprising: the video inputdevice of claim 19; and a video output device connected to the videoinput device by a bandwidth-limited link, wherein the video outputdevice comprises: an output device video input port, that receives thebandwidth-limited video stream from the video input device via thebandwidth-limited link; an output device video output port, thattransmits an output video stream configured for reception by a videodestination; an output video decompression module that decompresses thebandwidth-limited video stream to produce an uncompressed video stream;an output frame rate transformation module that applies an output framerate transformation factor to the uncompressed video stream to producean uncompressed, frame-transformed video stream; and an output videoscaling module that applies an output image scale factor to theuncompressed, frame-transformed video stream to produce the output videostream.